Amendments to Claims 



1 . (Currently Amended) A method for encoding a video sequence with a non-static 
viewpoint having a plurality of fram e s , said video sequence having a plurality of frames and 
comprising a background composite constructed from the plurality of frames and foreground 
regions for individual frames of the plurality of frames , comprising the step of: 

encoding said video sequence based on balancing bits per pixel for said background 
composite onc e p e r said vid e o s e quence with bits per pixel for said foreground regions on a p e r 
fram e basis to achieve similar quality between the background composite and the foreground 
regions in a reconstructed video sequence , wherein said bits per pixel for said background 
composite are based on a number of bits for texture encoding of said background composite and 
a number of bits for warp points of said background composite, and said bits per pixel for said 
foreground regions are based on a number of bits for texture encoding of said foreground regions 
and a number of bits for shape encoding for said foreground regions . 

2. (Cancelled). 

3. (Cancelled). 

4. (Original) A method as in claim 1, wherein said bits per pixel for said background 
composite and said bits per pixel for said foreground regions are related by a balancing factor. 
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5. (Original) A method as in claim 4, wherein said balancing factor comprises a 
correction factor. 

6. (Original) A method as in claim 4, wherein said balancing factor comprises a quality 

factor. 

7. (Currently Amended) A method as in claim 1 , wher e in said bits per pixel for said 
background composit e is bas e d on a numb e r of bits in a compr e ss e d background composit e , 
wh e r e in said bits per pixel for said foreground r e gions is based on a number of bits in 
compressed for e ground r e gions, and wherein said number of bits in said compressed background 
composite and said number of bits in said compressed foreground regions are related to a bit 
budget. 

8. (Original) A method as in claim 1, wherein said step of encoding comprises the step 

of: 

determining a background quantization step for said background composite based on a 
number of bits for a compressed background composite and an actual number of bits for said 
compressed background composite. 

9. (Original) A method as in claim 8, wherein said step of determining said background 
quantization step comprises the step of: 

encoding said background composite iteratively to obtain said actual number of bits for 
said compressed background composite. 
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10. (Original) A method as in claim 8, wherein said step of determining said background 
quantization step comprises the step of: 

determining an estimated background quantization step based on an estimated number of 
bits for said compressed background composite and said number of bits for said compressed 
background composite, wherein said step of determining said background quantization step is 
further based on said estimated background quantization step. 

1 1 . (Original) A method as in claim 1 , wherein said step of encoding comprises the step 

of: 

determining a starting foreground quantization step for said foreground regions based on 
a background quantization step for said background composite and a desired bit rate. 

12. (Original) A method as in claim 1, wherein said step of encoding comprises the step 

of: 

determining estimated frame dropping for encoding of said foreground regions. 

13. (Original) A method as in claim 12, wherein said step of determining said estimated 
frame dropping is based on a bit budget and a temporal sub-sampling. 

14. (Original) A method as in claim 12, wherein said step of encoding further comprises 
the step of: 

determining a background quantization step for said background composite based on said 
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estimated frame dropping and an actual number of bits for said compressed background 
composite. 

15. (Original) A method as in claim 1, further comprising the steps of: 
determining estimated frame dropping for encoding of said foreground regions; and 
determining actual frame dropping for encoding of said foreground regions; and 

if said actual frame dropping differs from an estimated frame dropping, determining said 
background quantization step based on said actual frame dropping. 

16. (Currently Amended) A computer system having software stored thereon for 
performing the method of claim 1 . 

17. (Currently Amended) A computer-readable medium having software stored thereon 
for performing the method of claim 1 . 

18. (Currently Amended) An apparatus for encoding a video sequence with a non-static 
viewpoint having a plurality of frames , said video sequence having a plurality of frames and 
comprising a background composite constructed from the plurality of frames and foreground 
regions for individual frames of the plurality of frames , comprising: 

a computer to encode said video sequence based on balancing bits per pixel for said 
background composite onc e p e r said vid e o sequence with bits per pixel for said foreground 
regions on a p e r fram e basis to achieve similar quality between the background composite and 
the foreground regions in a reconstructed video sequence , wherein said bits per pixel for said 
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background composite are based on a number of bits for texture encoding of said background 
composite and a number of bits for warp points of said background composite, and said bits per 
pixel for said foreground regions are based on a number of bits for texture encoding of said 
foreground regions and a number of bits for shape encoding for said foreground regions . 

19. (Currently Amended) A method for encoding a video sequence with a non-static 
viewpoint having a plurality of fram e s , said video sequence having a plurality of frames and 
comprising a background composite constructed from the plurality of frames and foreground 
regions for individual frames of the plurality of frames , comprising the steps of: 

determining a background quantization step for said background composite based on an 
estimated number of bits for a compressed background composite, a number of bits for the a 
compressed background composite , and an estimated background quantization step, wherein the 
estimated background quantization step is based on the estimated number of bits for the 
compressed background composite and the number of bits for the compressed background 
composite and an actual number of bits for said compr e ss e d background composit e; 

encoding said background composite once per said video sequence based on said 
background quantization step; 

determining a starting foreground quantization step for said foreground regions based on 
said background quantization step and a desired bit rate; and 

encoding said foreground regions on a per frame basis based on said starting foreground 
quantization step to achieve similar quality between the background composite and the 
foreground regions in a reconstructed video sequence. 
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20. (Currently Amended) A method as in claim 19, wherein said step of determining said 
background quantization step comprises the step of: 

encoding said background composite iteratively to obtain an said actual number of bits 
for said compressed background composite. 

21 . (Currently Amended) A method as in claim 19, wherein said step of determining said 
background quantization step comprises the step of: 

determining a background quantization step iteratively based on the an estimated 
background quantization step bas e d on an e stimated number of bits for said compress e d 
background composit e and said numb e r of bits for said compress e d background composit e , 
wh e r e in said step of d e t e rmining said background quantization st e p is furth e r bas e d on said 
e stimated background quantization stop , 

22. (Original) A method as in claim 19, further comprising the step of: 
determining estimated frame dropping for encoding of said foreground regions, wherein 

determining said background quantization step is further based on said estimated frame 
dropping. 

23. (Original) A method as in claim 22, wherein said step of determining said estimated 
frame dropping is based on a bit budget and a temporal sub-sampling. 

24. (Original) A method as in claim 22, further comprising the steps of: 
determining actual frame dropping for encoding of said foreground regions; and 
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if said actual frame dropping differs from said estimated frame dropping, re-determining 
said background quantization step based on said actual frame dropping. 

25. (Currently Amended) A computer system having software stored thereon for 
performing the method of claim 19. 

26. (Currently Amended) A computer-readable medium having software stored thereon 
for performing the method of claim 19. 

27. (Currently Amended) An apparatus for encoding a video sequence with a non-static 
viewpoint having a plurality of frames , said video sequence having a plurality of frames and 
comprising a background composite constructed from the plurality of frames and foreground 
regions for individual frames of the plurality of frames , comprising: 

means for determining a background quantization step for said background composite 
based on an estimated number of bits for a compressed background composite, a number of bits 
for the a compressed background composite , and an estimated background quantization step. 
wherein th e estimated background quantization step is based on the estimated number of bits for 
the compressed background composite and the number of bits for the compressed background 
composite and an actual number of bitr , for r . aid compr ft r . r. ft H hnnlrgrnnnH mmpn^jto ; 

means for encoding said background composite once per said video sequence based on 
said background quantization step; 

means for determining a starting foreground quantization step for said foreground regions 
based on said background quantization step and a desired bit rate; and 
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means for encoding said foreground regions on a per frame basis based on said starting 
foreground quantization step to achieve similar quality between the background composite and 
the foreground regions in a reconstructed video sequence. 

28. (Original) An apparatus as in claim 27, further comprising: 

means for determining estimated frame dropping for encoding of said foreground regions, 
wherein said means for determining said background quantization step is further based on said 
estimated frame dropping. 

29. (Previously Presented) An apparatus as in claim 28, further comprising: 

means for determining actual frame dropping for encoding of said foreground regions; 

and 

means for re-determining said background quantization step based on said actual frame 
dropping if said actual frame dropping differs from said estimated frame dropping. 

30. (Currently Amended) An apparatus for encoding a video sequence with a non-static 
viewpoint having a plurality of frames , said video sequence having a plurality of frames and 
comprising a background composite constructed from the plurality of frames and foreground 
regions for individual frames of the plurality of frames , wherein the apparatus is adapted to: 

encode said video sequence based on balancing bits per pixel for said background 
composite onc e p e r said vid e o s e qu e nc e with bits per pixel for said foreground regions on a p e r 
fram e basis to achieve similar quality between the background composite and the foreground 
regions in a reconstructed video sequence , wherein said bits per pixel for said background 
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composite are based on a number of bits for texture encoding of said background composite and 
a number of bits for warp points of said background composite, and said bits per pixel for said 
foreground regions are based on a number of bits for texture encoding of said foreground regions 
and a number of bits for shape encoding for said foreground regions . 

3 1 . (Previously Presented) An apparatus of claim 30, wherein the apparatus comprises 
application specification hardware to emulate a computer and/or software. 



- 10- 



09/809,036 



